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HUD «*©»«W«*^5BWIHii:VjUx> 
xV 7fll Sg<h <D«5Miltttt*ffiSS L/c^/Ux* xV 7 

[ft?j*#l8] :i-1«WLfcMHMatLfc**fc 
MT^T/l/x^x^ltllBlcfctLT, SKVJl/x^xV 

aao^i/** x-r 7« $fiicima-r«a^ witao)«5R 

TSK^JUx* x-r 7tf$8K»iSttttTiat*-rSWiItil 

s* nfc^/ux^ r 7it wumiMttiiittiai-r 



( Hft ) 



| 5 0 3 

I | - 1 5 04 

I tijia K 

I — I — 
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iiwziwtT-f Tmmmmmm-*-?^* x-r t 
Attmz£ y i-WBtirs^i/f^ x-f t"W*bic 
T*MfefiHis»xx-y:/^ 

Ta-j*r****Hfejaxxy7i:, 

W tt**ft LTaS7;l/f^f-f 7flRBtc*tt5ttttTlB 

mm&tt®i$im7,Ty zfiz* y rare tifc^/ux* x 
rr*Efc*tt»£T*7;bx*xV7i«MB»wi* 

titDZimTzmfctomt asu^x* xV rmt 

MHI 1 HMWI/** 5V 71* «MBft*9£ii. 
[MS* 3] fufBS^xv^cfc^T, 
iWBWfttfftfcWlflWIta-VKJl^-r*!*^ MSB 

maoD^ji/^/ x> 7it $Bt l < i*wm-«9*7;ux 

*xV 71t«*»&3Hai*«:fc»rt 1^70 hBSit 
LTa-tfU:ai5^*Ct*i«St-r*WE«ilWI1 * 
fdi 2 fcSMMWUx* TV 7tit $BIBS«S*»o 

A7J*3ttiBffiM©^;Ux*xV7l*8©Jltt1*«tt, 
SgRVUx/xV 7«fB©§Bi8ffiBtil$S i t> L < (tun*? 
/bx>xV7l*«'N«!>*'f Mk 3*>bfc£©x*7. 
Mt»?**Cfc*W£T*tJEIGOTl1 7123 w 

r*ifr 1 JSicsBiB^/bx/xV yimnaMn^ 

A;-xfcL<liWWW (Wo r I d Wide We 
b) ©x-*^-AT*»SC«h*^£?"*t!i!Bf»3»S 
1 712 3 O^ftitt 1 JSKfBigtf^bx^xV 7titfBfB 

Itmm 6 ] MfBStttifiiS^Xx •> 
taiBjftM©^/Ux*xV 7tif?Btf G P S88SpI«&&x-? 

itEwawiAEBo^u^y x-r /"tt^iBSBa^So 



£©^/ux*xV7it«£ies^rar3T;ux*x>7 
ittiiBWBis/ax-Afcfc^T* 

MiB->XxAl<:S8£ tlfeTjUx* TV 7* y v 
x 4 7« ttfcttUHHt tt*B«r SHttfll 

aLTttEraa^xyxVyitwcittT*!!*© 
Mtflia*if «iR*#aic cfc y gas* nfc^?; i/x y x -f 7 

<!:*1ta<fr« ViUx^x-f 7til «8Bii , 6S->7.x Ao 

zuiaiw^iESStfnfc^iUx/T-rzwa^Hifrs 
fc©*sE»rsiRfcHa*-3B»^i/x*xV7i*iii* 

Of 7 B«©-?/l/x> x -C 71* «E»*8->7. x A. 

[at aw 9 1 mmfr^mas^T. 
ma©^jux>xV ytWBt. l < H:B*r*sw^i/x 

/xV7l«l*»«irai*tI»fcfcl'-r7* HBB 

LT3.-wca5vr*c t*i«str*WB»awi7 * 
fcti 8 iBero^;uxp< x < rmmmsmfXT-ik. 
mm i o ] im&mm&stKti^T* 

1HB5/Xx AlC Afc* SlWSWMWUx/ xf 71**S 
©JStt1*tB.fcLT* Sf^r/Ux^xV 7l**fi©I3iite{I 

itatL<ttair7;ux^x-f7fliai^o^'i'hik □ 
yynkirfl!>x*xniHi*w«-r*ct*»«if* 

ft «^ 7 712 9 <7)^-rtl6M ^lCfBtti7)^;Ux^ x -< 7 
if*SfS»«JI>'Xx/x„ 

«w**str*«Ejn«niwi^ H^*ift§<t:'ox 

— Sf^-7.tL<«WWW (Wo r I d Wide W 
eb) ©x— Z^-XT*&%Zt*®ntt%Wmi$. 
«77b29©^-rtl6M«ltEttO?/Ux?<X'f7flia 

laattas/^xAo 

B5fB->XxAtcg«*nfcffii3RFrS©^)Ux^x< 7til 
mfcThZWi'SKs ^ig7;Ux^x-f7lf^©Stt1fffi 

x^x-r7lffSIB^Sa->XxA„ 
[0001] 
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[0002] 

iwnm&m ft3fc©^/ux*x>7itfgie8*3i£ft 
=>*><DtLz&. man* n-vi-n^y\d3.-^±X' 

Y> h5*-y h££©*'y h9-?±T'ftfrr5»jfO£ 

h-4£©x*:* Ht«*»*li[la.fc , J, IB» 
^J^iBSKfiiSS if lc* o TEWIIWMBElcirattW- 

[0003] 

[«W»J*L £ fe^<t-r5ilS] LfrLStf 6x ±!3ft 
JK0V7>2x7&tf:>*xATH^ GflHWIRKttrS 

it m*m.mm Lfea-+f*AS£«^:rj>s<E>a--+f 

[0 0 0 4] EailHltiSOMftWKIIlTfc 

[ooo5] co&ttfommt. sBStiisisswsia 

[0 0 0 6] CWfttti. -<V$-*7h/'rvh7*'y 

tt % »lc % a-tftfB««ilcSLT«SilQa.fcx*X 
h1fi5^iRI3aHf«a)5BStft!Bfe<»:«)1f««:*iJffl-r5 
Ctfciy, ^MiB^flS$6l^LTa^a)llliai1IS«-@ 

[0 0 0 7] COJ:5*IB«jS[*»aT«fc 

ftfttreHCT *1tS*JR* LT^/i/x* xV 7lt«£ 
®»SWiWt«aai Lfc^/Ux* x -r TMHWIBMSl 



[0008] 

§m<om**nmMmttwt* -roots ye**. 

[0009] ( 1 ) a— ? ffW LfcB«*EM Lfc* 

js& ta^i/x* xV 7ffi*s£i3g*e3-f *^;ux * x 

-f T'flMEWPS&aKfet^ A7J#K£<fc y a-tf 

ttis?rs©-*vi/x*xv 7if«itiHitf «a-*oita© 
i3ffis©v;ux*xV7tt8tei!sm-3«4©ifi$ : &iK 
^f«a^xx'y^t**-rs. 

[0010] (2) (1) ©7M/x;><xV7ti!$Bf3SI , g 
a*»OW!BI»aif«JRSl^x-y7lctet>T^ OftdTti 
fcHaflWPfcoT. fufBmM<7)^/Ux*x>7lt*8J.X 
ftfc^VUx* xV 7flWtf WOTStCfcE 
S*3P8fcHa*-5B»7/Ux*xV7lt«*» 

[0011] (3) (1) Sfctt (2) 05^;Ux><x< 
7ltSf3a!Ba^OMfB^X7 1 -y7lcfc^T> tuSB 

©T/i/x* x-f 7itafe l < tiraa-rsasK-ji/x^x 

-r 7l«B£«t!:%M3I1t«S*l>3l;: hiESLT 

[0012] (4) (1) 7S£ (3) ©^-fWrlOO 
T/Ux* xV 7lf^l3S ( BS*»WSiiBJS141t$B^X 
x'yyicfc^Ts A7Jf«BuSBRFrS<0^;Ux^x-f7tt 
$8<*>Ji141f $8li> SK^;Ux/ x-f 7ffi $g<D§Bi8ttaif 
«t,L<«a^Uxp<x'r71f^a)^-r h;k a* 
> KS£Ox*X r-tit$BT-££o 

[0 0 13] (5) (1) JIM (3) Cl^ftAMO© 
^il/x/xV 7lt«S3« i Ba^a©BuiBKait?8iR«7. 

?^-Xt.L<liWWW (World 
Wide Web) (Dx-^^-XTfeSo 
[0 0 14] (6) (1) Sfcl* (2) ©V/lrr/x-f 

7ttsiBsea*s©iui3seif asa^xx y znz&v 
fji3ms©v;i/xp< x-r ymmif g p s g«pr^§ 

[0 0 15] (7) i--W«l*LfcMHMB»Lfc* 
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minted iw* x> ym $bt*s y . ^i-w/?f2 

* Tmimmtzmmntitmm: lt, 
;ux* x<r 7i«iarflKiit ««tt*ii5*r*a 

[0 0 1 63 (8) (7) CD?;bx*xV7'1t$8fB»S 

fcMiiflMreaBoTs miemao^uxyxVT'iwiiJji 
*icfi»*ftfc7;ux*xv 7"it«tfMii-rsfc©siB 
»-rsP8tcH5irs^8^/i/*p< x-r 7>nm«*effii 

[0 0 17] (9) (7) (8) (D?W^T-f 

iBB(i*nfcHiiiwi*iL-»f(cam-r*iR(c. Susb^m 
©^/ux/x-r 7it m> l < «H«-f ssa^/ux^x 

a— "fleas***. 

[0018] do) (7) nm. (9) wfwpio 

©7;Ux* x f 7'1t$Bi3^tta->7 t xi,<7)luiBJitt1«« 

M*aKfi^T» BufB-v^xAicATj-rstuiBmacD 

7/Ux*xV7l*l8©JStt1t8itt> 3K^7l/x*xV7 
tll$gWlB^a!I1ff^t» L < tta^/l/f^r-f BURR'S 
C^fhik :3*>hft£©x*Xr-1IHlT**. 
[0 0 19] (11) (7) 7SS (9) ©tvfftfrlO 
7 7 «fSfBSl^S'XxA©fj5BMi!1ff« 

a. &ummi:<DT-<5"<-7,$> l < (*www (wo 

rid Wide Web) <Dx—S"^-;*T*»*o 
[0020] (12) (1 0) <7r7/l/x*x<r7'1ll«!E 
gi«a->XxA©tugBJitt1tSSS^SlC*30^T> lulB 

g p s^prtiSx^^/i/A^^ictyaHg^nftiM* 

[002 1] CftSlCfcU, l-W»LftB« 
ii Lfc^PS £©v;Ux* xV 7 , 1WI«BmPIf *» 
*ftS©i3ttffiB1t$B-*>*'<' Hk =l*VHS<i:© 

tij&*Sfr s*©^/i/x><xv j'titsfcima-r © 
mcc sidiR* LTB»*ftfc^i/x*xV 7tii$s©* 



K&mzmw Ltc^i^y- xV Tmmmmmm. 

[0022] 

»m©fttt©jgtt] cmc* ^gm^idkio^ncH 

SB«WBLTBW1TS. H1& *5WI©-**BB»c 

BW*fctt©H?**. ■ HOST J: 31=, **S6flS!H 
©?;Ux*x>7'm$BSBti l g3I->XxAtt, ■ 

x~: 5/ 3 /<1 0. /t-VribaVti-^* 

©^-fW^O, HM«««#-??**x-*'*-X 
3 0jtra-ft*ft*y h-7— ?4 0lC«fcoT««LT^ 
*„ *fc» ±ffi*-y h7-*40ttWWW (Wo r Id 
Wide Web) 5 0fcJM*LTV*. 
[0 0 2 3] ±S3tr-M-1 0Slf^7-r7'Vh2 0 
« v WCCPU11, 2 l&tfp't'JgBI 2. 2 2. 
?*xatf*-#-K»©»3SA*Sl 3, 23, 7^ 
X7Ufa£©«aWl 4. 2 4tr6*MMfftT& l J. 
V-/f1 04»<%'JttB rtBn-KxVX 

*) i 2ict±, 3.-ytfmttz?tiWLtzwm j t>tm 
«j«*£©*^/i>x* t ■< 7ita*ttiirt ufc^/ux* x 

7t-?7 7"f JMktf * ft6^;l/x* x <f 7"» f8©H 
ttlWlStf H*Mi*^T*7jUx* x> 711HIS8 

«77<jh 2 0£, *©Emra*ff37;u^yT 
<7'tii«i3S«ayn^7Ai 2 1 fctfrawrhTv 

*o 

[0 0 2 4] ±Bt s -5"<-X3 0(*» t-7-Htt 

B«*l>5?V£#5&*«SRive>>3 1 x*X 
Hfar-5"^-^3 2, <£S1tfBx-^-7.3 3, 

s^v^-^x— s^-x 3 4 ifrSftsjnsHta©* 

tfWMMrftl**, 
[0 0 2 5] x*7.Ht$8x~ *"<-X3 2fctt, H2 

Ka*r* 3 ic s&*Aft £©E»wua usHiictt* 
*nTt^i3*77"r;i/ef3 2 1 <t. WR«ra*«ttr 

*fc*©JHKVr v ^^x-^/U3 2 2<MM**ftT 
dC7*S-fVx'y^X7 : -7/U3 2 2i:li, W 

St* tltfT'T < SfB*©iB*7 T -</U«*«fc Lfcx 

[0 0 2 6] ffi«m«x— f^-X3 3Wi, B3K$ 

t-«fc3ic am 3 3 2£ttftr**«uriira3 3 1 © 

fiffttlA*ftTLV&= $fc. ^9>^-5?x-*^-7. 
3 4KB, B4tcwf «ISS^1f$BA^Sf*, 
«Bt> Hatft^tlc 1 r— 9 3 4 1 «h LTIB^* ftT 
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[0 0 2 7] *XimmD*l\&*5 t 4 7lHU& 

sit. *mMm<»^}i?*T*7fflmMmm^7,7- 

[0028] *$msnm*i\&*T47mmEam& 
^□^ai 21 commit. msiz^taviz. a-tr 

■ttflHIBWaa (Xx-y75 0 1 ) t. *©Btt1tf8 
NH (777^5 0 2) t-Qttftt-trSKHHff 

x->^5 0 4) i:fr5&3= 
[0 0 2 9] ±fS«tt1tffiga5[ia Ur^5 0 1 ) 

<r7 r fflllCttLT. "?5>r7>h2 0©Ji^A7]SP2 3 
LT2-WSf©7)bf^ x-f 7"l1H8©fBStii» 
1HK»L<tt* *©^;bT^xV7'tiHS'\©-S'-f' Hk 
a*>h££©x*Xh1t*8©A7j£§«\ +r-M*i o 
±©^€>JgI1 2 KfBSi? %fc.il <7>ffBtRffiB1* 

«iiSiO«fiBffiS1WITftoT. ^Jbx*x<r7'1iatfG 
PS (Global Positioning Sys 

tem) wmwt TWivts*^ -cmmzntcwm-? 
4Lfc^"r nut. ix tin i-*e»r5t<DT'«o 

[0 0 3 0] ±H***-£rt»l Ur^5 0 2) 
7l*v 0 ©CPU 1 1 Ki5loT> K141tl8fl8 

x-*"<-X 3 0 1 L < liW W W 5 0 fcfcSRTSfcft© 

U #-fMk □ h££©x*Xh1t8tfA*J*tt 
7-K<fcLfc*>©****-fcLT£rtT*. Sfc> if 

[0031] ±EWHt«'KftHa Ux*75 0 3) 

A"1 0<):'j7-M-730fcL<ttW 
WW5 0fl«»I>y>3 1 KHfflLT7'f;l>* , J>?' 

[0 0 3 2] tt*+-««IBJMttS»ifi1f«T4x.6tifc 
£ti» *-9- K&*X>S?VlC<fcyx-*'*-7.3 0 



©x*X MHix-* "K-X 3 2 fe L < ttWWW 5 0 « 

EiMJ»UfcJ:«timfitt***ttLT> 

LTv *©OT«SJIl*tf-/{1 0 13811 LTffi»<D7/U 
Wr-f TfflUzKfcttlfTV—J * 1 OO^'JSBI 

2 ices?-*., 

[0 0 3 3] COMaif«JR*jl!ia (Xx*75 

03) it. im<o*iw*T47m»JAnizm&tNa 
m&m uf»ysoi) „ u?* 

75 0 2). &tfn%miiKft»Jl U7^5 0 3) 
*T Lfc?;l/x* x> T 7 * (WWW* < t t-o 

J.X±$*«^lcliv *ftS7;l/x*x-r7'fll»::ttUK 

ti^ranm trmcn-ziw* x> Tinman 

x -f 7flrao Wifll SB tWbTJl/f^f-f 7"»fB <h © 
M>Itt£Mr£fc©T&oTfcJa\, *SlCv ffi©^ 
Jbx*xV7flMtfBaT*WI1Wi*±EffiB©7JU 

[0 0 3 4] ±IBfil^SaS »7*^S04) fct ±IB 

teHSfSfcoWA j?fS©?/l/x*xV7'1t«'bL 

[0035] BfaflD^i/x/x-fziwiaifWirsa 
»T;ux/xV7MWHHH»«?**»£fc» 
*^*ft«iraiWi©*»rtfcU'r7'* KEBjnT 

(X7775 0 4) Oiiffi(73^J€:ll 6 IC^-Te £©06 

tcwrwra. iwBffc6o»ra©*tk isantis© 

ft&\ CflDM'79hW:CftfcH***l* , t»©"H*ft 

[0 0 3 6] ±IB7;l/x^x^7 7 1f$gfBS'SS-> 

7. 3 0 1, L < ttWWW 5 0 ©fcSRfflSfcRSSl/^ ^SftS 
5^7>f-20©CPU1 IStf^^'JSm 2^ 

[0 0 3 7] ^lc, ±aELft**S6fBJS©7;bx^7 :; 'r 

mwzmmzo zctit. zi.-*fm\\>=j-*7<7'to 

[0038] *r» sttltsassaa (77^50 
1) T-tt, a-m +r— y^i o©/*y*Bi 2 leg 
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^^^yy h 2 oic^7>n- klt*5**2 4icttj 

[0 0 3 9] *LZ. ^©^/b^rVTMiSSfcHIEL 

Ht^^/TxA^gP 2 3 lz£ y A^J-T «o 
[0 0 4 0] 07&tfEI8tt, ^'TT'VhlC^VP 

■ttflMBwaa Ut7^5od u^ot^-tt' 

[0 04 1] «KEfll(c£^T r77"r;l/£j 24 1 

7"r/u& mam ©cti-soT, a-yoawa 

MM (M#©?t5'J>£<<ht,-7J) £A7J-f3, 
[0042] H7& 77"f/b424 1# ™oOO 
OJ ?S«WHM£**LT< *-f HU2 4 2atfa* 
V h 2 4 3 MHI©**A* Lfcfltatt". 

[0 0 4 3] -15s B8& 77"<;Ui&2 4 16 , i Hf* 
AAAAj T**iHBH«fc»LT* ^OlMltfiHB* 

nfc»m©aiBffi«ifa ouaifle) 2 4 4<d**a7j 

[0 0 4 4] «KffilHHI2 4 4(DAAtt. 

frtaW— /t1 0©y^U«B1 2lc«?*Hx-*"< 

y, *o!)B«MW*ftfc#'r>h«iao*H*^5'r 

7>Vh<D»^2 4lCtttfrP#*J:3fcLTi3S, *6 
fc7***£0SS*A**2 3lc,fcoTlM±-M-fl« 

mmnm 2 4 4 * a^t-i*** a k lt£^t** 

fcli^)ftS«S1t$B=&A7JffllCx7*;Uh*^LT (E 
f()MIIW»UE^lcSO«ltLn:«H««f 

[0045] *LT» BTET©B»#*:>2 4 5«W 
E £ «fc »J ®ffiTA7J Lfdf t10K7 » 7p 

-ku -y- mi owyt'/sm 2^ttirt*ti5v;i/ 

xV 7flHIEMB17 ;n 2 o kg*? So 
[0 0 4 6] H91C« ■ttflmiHWH Ux->75 0 
1) K«fcyA**ftfc» raptooOOj TkV r^jtA 
AAAj ©JBtttiHBtf^/t^* xV T'til «SBSeS7 7 

•r/H 2oiciB»*ti577"r;HBai©«!i^"ro 

[0 0 4 7] 09lc^-TJ:-5lc, ^l^x-rT'tilSBiB 
MMTWJM 2 0fctt77"fM>*» JMBttUMU 

f< 711 «IB« < BS7 7"T/H 2 0 'NOfBliUU E ftic 



[0 0 4 8] tt**-£jttaa Uf'yyso 
2) ra. ±i$ urc * x < y^mmmm-y t -r 
;n 2 0fcra*ftfc^;u**xV7'it«©Mttni^ 
6s ot L<iiwwws otwursft 

aM»**-*tf-/ti oocpu 1 1 tcfcysrtr 

5o 

[0 0 4 9] ±iE© T^JtOOOOj KttLTtt* A7J 
Jftfc^'T K/U2 4 2, =l*y K2 4 3©x*XMIf8 

«) tttiau ch(c«fcy««*-*ffrtr*. 

[0 0 5 0]-*, r^HAAAAj KSLm IBS 
ttfttt (35/00/43.5,135/47/07.3) T*Jl!*-*fMW 

(Cfc^T, »Rffiil1*?82 4 4, atf*-TM/2 4 2 4: 
=1^ V h 2 4 3©x« hffllOJDOMMinNIJ: LT 

2 4 4. Jklf-Sff K/U2 4 2. P* > h 2 4 3lcA7j£ 
*lfcx*7. MI»Sft«Lfc*-9- KOH*cJ:y 

[0051] ■anra««ffia Wf7 7"so3) t- 

tt, Ux-v75 0 2) W*L 

n*dl!*-**-/<2 0frS5 ff -* / <-X3 0*>L<tt 
WWW 5 0(D«lgXV^>3 1 fc«BLT*©7;U** 

[0 0 5 2] ±a© r^nooooj IcWLTtts t- 

^^_x3 0tU<l*WWW5 0lc3<tLT> 

» (OR**) ^nasr^o 

[0 0 5 3] T-^-X3 06J:tfWWW5 

O^iaStt. x-*^-7.3 0lcflLTt. 

WWW5 0lc^LTtl?l«llc*li*tl5ft46. CtT- 
tt, 9"<- 7.3 0 Lfc*-7- FttHiKO 

[0 0 5 4] *-7-K«*tt, A**ftfe«W*Bt 
■ 2lCwrJW-f >7 f 'y^7sX-7VU3 2 2*<Di&!f£ 
#!SLT. -iScL/c^S, ^©#H^tJf3»7 7"l' 
Jl**y* Mb«EilC*9T*li*ft*. 
mg-fVx'y7X7 1 -7;l'3 2 2lc»LTs TalPffli 

FiFfj T**f5t©IB&B ! J«*U *0!)firOB»77"f;b 
ftyxh rfB*****x » v J tf» «BMS«i: LT» 

[0 0 5 5] WMSJRKiB. tt«*tlfcaW3B« 

S«S5S*S©aiil«JglCcfc^TS«?n«o Sfc, an 
T££LT, ORWtt««MWKS«-*«SMSIW«a 
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(54) METHOD AND SYSTEM FOR RECORDING AND MANAGING MULTIMEDIA 
INFORMATION 

(57) Abstract: 

PROBLEM TO BE SOLVED: To provide a method and a system for recording and 
managing multimedia informationwith which mutual relating of related 
information and multimedia information is expanded from various 
knowledge information sets. 

SOLUTION: Concerning the multimedia information recording and managing 
method for recording and managing the multimedia information of images 
photographed by a user or recorded audiothis method has an attribute 
information registration step for registering attribute information to 
the multimedia information desired by the user by an input means 
corresponding to the relevant multimedia informationretrieval key 
generation step for generating a retrieval key for executing the 
retrieval of various information related to the desired multimedia 
information while using the registered attribute information 
corresponding to the set (knowledge information set) of the other 
knowledge informationrelated information collection step for collecting 
the various information related to the desired multimedia information by 
retrieving the knowledge information set while using the generated 



retrieval keyand recording the collected information corresponding to 
the relevant multimedia informationand presentation step for outputting 
and presenting the multimedia information and related information 
collected by the related information collection step. 



CLAIMS 



[Claim(s)] 

[Claim 1]A multimedia information recording method which records 
multimedia informationsuch as a picture which a user photoedand a 
recorded soundcomprising: 

An attribution information recording step which registers attribution 
information to the multimedia information concerned to multimedia 
information for which a user asks by an input means. 

A search key generation step which generates a search key for retrieving 
various information relevant to multimedia information of said request 
to a set (knowledge-data set) of other knowledge data using said 
registered attribution information. 

A pertinent information collection step which searches said knowledge- 
data set using said generated search keycollects various information 
relevant to multimedia information of said requestis matched and is 
recorded on the multimedia information concerned. 

A presentation step which carries out output presentation of multimedia 
information and pertinent information which were recorded by said 
pertinent information collection step. 

[Claim 2] It is the pertinent information collected in said pertinent 
information collection stepSaid multimedia information recording method 
according to claim 1 recording registration multimedia information 
related when recording that to which multimedia information with which 
it registered other than multimedia information of said request relates 
with the relevance. 

[Claim 3] In said presentation stepwhen showing a user said collected 
pertinent informationSaid multimedia information recording method 
according to claim 1 or 2 carrying out layout arrangement into a 
pertinent information document which carries multimedia information or 
related registration multimedia information of said requestand showing a 
user. 

[Claim 4] In said attribution information recording stepattribution 
information of multimedia information of said request to inputA 



multimedia information recording method given in any 1 paragraph of said 
claims 1 thru/or 3 being text informationsuch as a title to recording 
position information of the multimedia information concernedor the 
multimedia information concernedand a comment. 

[Claim 5]A multimedia information recording method given in any 1 
paragraph of said claims 1 thru/or 3wherein knowledge-data sets which 
search in said pertinent information collection step are databasessuch 
as an encyclopediaor a database of WWW (World Wide Web). 
[Claim 6] In said attribution information recording stepMultimedia 
information of said request with a digital camera in which GPS 
connection is possible. Said multimedia information recording method 
according to claim 4 registering photography latitude longitude 
information automatically given to the taken image concerned as 
attribution information of the multimedia information concerned when it 
was the photoed picture. 

[Claim 7] A multimedia information record management system which records 
multimedia informationsuch as a picture which a user photoedand a 
recorded soundcomprising: 

An attribution information registration means to be the multimedia 
information registered into said systemand to register attribution 
information to the multimedia information concerned to that for which a 
user asks by an input means. 

A search key creating means which generates a search key for searching 
to a set (knowledge-data set) of desired knowledge data using said 
registered attribution information. 

A pertinent information collecting means which searches said knowledge- 
data set using said generated search keycollects various information 
relevant to multimedia information of said requestis matched and is 
recorded on the multimedia information concerned. 

A presenting means which carries out output presentation of multimedia 
information and pertinent information which were recorded by said 
pertinent information collecting means. 

[Claim 8] It is the pertinent information collected in said pertinent 
information collecting meansSaid multimedia information record 
management system according to claim 7 recording registration multimedia 
information related when recording that to which multimedia information 
registered in addition to multimedia information of said request relates 
with the relevance. 

[Claim 9] In said presenting meanswhen showing a user said collected 
pertinent informationSaid multimedia information record management 



system according to claim 7 or 8 carrying out layout arrangement into a 
pertinent information document which carries multimedia information or 
related registration multimedia information of said requestand showing a 
user. 

[Claim 10] In said attribution information registration meansas 
attribution information of multimedia information of said request 
inputted into said systemA multimedia information record management 
system given in any 1 paragraph of claims 7 thru/or 9 using text 
informationsuch as a title to recording position information of the 
multimedia information concernedor the multimedia information 
concernedand a comment. 

[Claim 11] A multimedia information record management system given in any 
1 paragraph of said claims 7 thru/or 9wherein said knowledge-data sets 
which search in said pertinent information collecting means are 
databasessuch as an encyclopediaor a database of WWW (World Wide Web). 
[Claim 12]When multimedia information of said request registered into 
said system is the picture photoed with a digital camera in which GPS 
connection is possible in said attribution information registration 
meansSaid multimedia information record management system according to 
claim 10 registering photography latitude longitude information 
automatically given to the taken image concerned as attribution 
information of the multimedia information concerned. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] When this invention records the picture which 
the user photoedthe recorded soundetc. it is applied to the multimedia 
information recording method and system which collectcombine and record 
various pertinent information from various knowledge-data sets to 
recorded informationand is effective art. 
[0002] 

[Description of the Prior Art] The notice version system which operates 
as what performs the conventional multimedia information recording on 
networkssuch as album management software which operates on a personal 
computerthe Internet/intranetfor exampleand an online album system are 
mentioned. It is possible to carry out record reproduction of the 
picture etc. which the user photoed for the travel etc. in these 
software and systemsA user can add text informationsuch as a title and a 



commentto the recorded information on a taken image etc. or recorded 
information can be mutually associated with recording timea recording 
positionetc. In the system of network typessuch as the notice version 
systemrecorded information can be perused freelywithout a user receiving 
restrictions of time or space by sharing on a network. 
[0003] 

[Problem(s) to be Solved by the Invention] However in the software and the 
system of the above-mentioned former, the user to whom the input of text 
informationsuch as a title to recorded information and a commentcarried 
out photograph recording of the information — since it carried out by 
the user of specific small numbersuch as the person himself /herself there 
was a problem that the contents will be restricted to these specific 
users' subjectivity. 

[0004] Since it carried out only about relevance with obvious recording 
timerecording positionetc. also about correlation between recorded 
informationthere was a problem that a user does not notice between 
recorded information temporarily and that they were not expressed even 
if it is a case where the relevance in which others are [ history and 
culture being - and ] un-obvious exists. 

[0005]Such a problem is also a factor which the correlation range 
between recorded information narrowsand had become the hindrance at the 
time of perusing recorded information freelywithout a user receiving 
restrictions of time or space by sharing on a network. 
[0006]For this reasonin sharing recorded information on networkssuch as 
the Internet/intranet. By using the information on the recording 
position etc. of the text information which the user added to recorded 
information especiallyor the recorded information concernedlt becomes 
useful to carry out correlation between recorded information generating 
various pertinent information automatically to the recorded information 
concernedand by choosing the thing relevant to other recorded 
information out of the generated pertinent information. 
[0007] this invention is accomplished in order to solve such a problemand 
it comes out. The purpose is to provide the multimedia information 
recording method and system which collected information related from a 
knowledge-data set of **and extended the mutual correlation with 
multimedia information. 

The other purposes and the new feature are clarified with description 
and the accompanying drawing of this specification along [ said ] this 
invention. 
[0008] 

[Means for Solving the Problem] It will be as follows if an outline of an 



invention indicated in this application is explained briefly. 
[0009] (1) A multimedia information recording method which records 
multimedia informationsuch as a picture which a user photoedand a 
recorded soundis provided with the following. 

An attribution information recording step which registers attribution 
information to the multimedia information concerned to multimedia 
information for which a user asks by an input means. 

A search key generation step which generates a search key for retrieving 
various information relevant to multimedia information of said request 
to a set (knowledge-data set) of other knowledge data using said 
registered attribution information. 

A pertinent information collection step which searches said knowledge- 
data set using said generated search keycollects various information 
relevant to multimedia information of said requestis matched and is 
recorded on the multimedia information concerned. 

A presentation step which carries out output presentation of multimedia 
information and pertinent information which were recorded by said 
pertinent information collection step. 

[0010] In said pertinent information collection step of a multimedia 
information recording method of of (2) and (1) It is the collected 
pertinent information and registration multimedia information related 
when recording that to which multimedia information with which it 
registered other than multimedia information of said request relates is 
recorded with the relevance. 

[0011] In said presentation step of a multimedia information recording 
method of of (3) (l)or (2) When showing a user said collected pertinent 
informationlayout arrangement is carried out into a pertinent 
information document which carries multimedia information or related 
registration multimedia information of said requestand a user is shown. 
[0012] In said attribution information recording step of any one 
multimedia information recording method of of (4) (1) to the 
(3) attribution information of multimedia information of said request to 
inputThey are text informationsuch as a title to recording position 
information of the multimedia information concernedor the multimedia 
information concernedand a comment. 

[0013] In said pertinent information collection step of any one 
multimedia information recording method of of (5) (1) to the 
(3) knowledge-data sets which search are databasessuch as an 
encyclopediaor a database of WWW (World Wide Web). 
[0014] In said attribution information recording step of a multimedia 



information recording method of of (6) (l)or (2) When multimedia 
information of said request is the picture photoed with a digital camera 
in which GPS connection is possiblephotography latitude longitude 
information automatically given to the taken image concerned as 
attribution information of the multimedia information concerned is 
registered. 

[0015] (7) A multimedia information record management system which 
records multimedia informationsuch as a picture which a user photoedand 
a recorded soundis provided with the following. 

An attribution information registration means to be the multimedia 
information registered into said systemand to register attribution 
information to the multimedia information concerned to that for which a 
user asks by an input means. 

A search key creating means which generates a search key for searching 
to a set (knowledge-data set) of desired knowledge data using said 
registered attribution information. 

A pertinent information collecting means which searches said knowledge- 
data setcollects various information relevant to multimedia information 
of said request using said generated search keyis matched and is 
recorded on the multimedia information concerned. 

A presenting means which carries out output presentation of multimedia 
information and pertinent information which were recorded by said 
pertinent information collecting means. 

[0016] In said pertinent information collecting means of a multimedia 
information record management system of (8) and (7) It is the collected 
pertinent information and registration multimedia information related 
when recording that to which multimedia information registered in 
addition to multimedia information of said request relates is recorded 
with the relevance. 

[0017] In said presenting means of a multimedia information record 
management system of (9) (7) or (8)When showing a user said collected 
pertinent informationlayout arrangement is carried out into a pertinent 
information document which carries multimedia information or related 
registration multimedia information of said requestand a user is shown. 
[0018] In said attribution information registration means of any one 
multimedia information record management system of (10) (7) to the 
(9) Attribution information of multimedia information of said request 
inputted into said system is text informationsuch as a title to 
recording position information of the multimedia information concernedor 
the multimedia information concernedand a comment. 



[0019] In said pertinent information collecting means of any one 
multimedia information record management system of (11) (7) to the 
(9) said knowledge-data sets which search are databasessuch as an 
encyclopediaor a database of WWW (World Wide Web). 

[0020] In said attribution information registration means of a multimedia 
information record management system of (12) and (10) When multimedia 
information of said request registered into said system is the picture 
photoed with a digital camera in which GPS connection is 
possiblephotography latitude longitude information automatically given 
to the taken image concerned as attribution information of the 
multimedia information concerned is registered. 
[0021]When multimedia informationsuch as a picture which a user 
photoedand a recorded soundis recorded by theseby using text 
informationsuch as those recording position informationa titlea 
commentetc. Since a semantic content of multimedia information registered 
from various knowledge-data sets by carrying out automatic collection of 
the various information relevant to the multimedia information is 
informationally extensibleA multimedia information recording method and 
a system which extended mutual correlation with pertinent information 
and multimedia information from various knowledge-data sets are 
realizable. 
[0022] 

[Embodiment of the Invent ion] Belowan embodiment of the invention is 
described with reference to drawings. Drawing 1 is a figure for 
explaining the composition of the multimedia information record 
management system concerning one embodiment of this invention. As shown 
in drawing l the multimedia information record management system of this 
embodimentThe server client type system configuration is taken and the 
clients 20such as the servers lOsuch as a workstationand a personal 
computerand the database 30 which is knowledge-data sets have connected 
with the network 40respectively. The above-mentioned network 40 is 
connected to WWW (World Wide Web) 50. 

[0023]Both the above-mentioned server 10 and the client 20 comprise the 
indicators 14 and 24such as the instruction input parts 13 and 23such as 
CPUs 11 and 21 and the storage devices 12 and 22a mouseand a keyboardand 
a displayln the storage device (for exampleinternal hard disk) 12 of the 
server 10. The multimedia information recording file 120 which stores 
the attribution information and pertinent information on the multimedia 
data files in which the user stored each multimedia information photoed 
for the travel etc. such as a picture and a recorded voiceand these 
multimedia informationThe multimedia information recording program 121 



which performs the recording is recorded. 

[0024] The search engine 31 which the above-mentioned database 30 becomes 
from the retrieval-by-keyword engine which performs retrieval by 
keywordand the position retrieval engine with which position information 
is searchedlt comprises a set of the knowledge data which consist of the 
text information database 32the position information database 33and the 
town page database 34and is. 

[0025] As shown in drawing 2 the word index table 322 for reportssuch as 
an encyclopediato carry out retrieval processing with the report file 
group 321 stored according to the entry is stored in the text 
information database 32. In the word index table 322it is the data table 
which is the index which showed which word is contained in which report 
about the word contained in all the reportssuch as an encyclopediaand 
made the group the word and the report file name of the report out of 
which it comes here. Creation of a word index is realized by 
morphological-analysis processing of all the reports. 
[0026] The address 332 and the corresponding group of the latitude 
longitude information 331 are stored in the position information 
database 33 at drawing 3 so that it may be shown. As shown in drawing 
4both the store namethe addressand the type of industry are recorded for 
telephone number information on the town page database 34 as the one 
data 341. 

[0027]Nextthe contents of processing of the multimedia information 
record management system of this embodiment are explained in detail. 
Drawing 5 is a process flow figure showing the flow of processing of the 
multimedia information recording program 121 in the multimedia 
information record management system of this embodiment. 
[0028] Processing of the multimedia information recording program 121 of 
this embodimentThe attribution information registration processing (Step 
501) which registers the attribution information over the multimedia 
information from a user as shown in drawing 5 It consists of the search 
key generation processing (Step 502) which generates the search key for 
searching based on the attribution informationpertinent information 
collection processing (Step 503) in which pertinent information is 
collected based on the search keyand presentation processing (Step 504) 
which shows a user the collected pertinent information. 
[0029] In the above-mentioned attribution information registration 
processing (Step 501). passing the instruction input part 23 of the 
client 20 to the multimedia information of the request registered on the 
server 10 — the recording position information of a user to the 
multimedia information — orlt records on the storage device 12 on the 



server 10 in response to the input of text informationsuch as a title to 
the multimedia informationand a comment. This recording position 
information is the latitude longitude information of the point which 
photoed or recorded desired multimedia informationWhen multimedia 
information is the picture photoed with the digital camera in which GPS 
(Global Positioning System) connection is possibleit is desirable to use 
the photography latitude longitude information automatically given to 
the projection picture. Text information may register the title or 
comment given when the multimedia information was photoed or recorded. 
[0030] In the above-mentioned search key generation processing (Step 
502) the search key for searching database 30 or WWW50 based on the 
attribution information inputted by attribution information registration 
processing (Step 501) is generated in CPU11 of the server 10. When 
recording position information is inputted as attribution 
informationrecord latitude longitude information is used as a search key 
as it isand when text informationsuch as a title and a commentis 
inputtedwhat extracted and keyword-ized the noun is generated as a 
search keyapplying them to a morphological analysis. When both are 
inputtedit is what combined the search key generated from eachand a 
search key is generated. 

[0031]It refers to the above-mentioned pertinent information collection 
processing (Step 503) by submitting the search key generated by search 
key generation processing (Step 502) from the server 10 to the database 
30 or the search engine 31 of WWW50and performing filtering processing. 
[0032]When a search key is given by record latitude longitude 
informationWhen a position retrieval engine performs position 
inclination search in which search by latitude longitude is possible and 
it is given by a keywordretrieval by keyword of the text information 
database 32 or WWW50 grade of the database 30 is carried out with a 
retrieval-by-keyword engine. When a search key is the combination which 
is record latitude longitude information and a keywordposition 
inclination search by record latitude longitude is carried out firstand 
then search by a keyword is carried out to the search results. And the 
search results are transmitted to the server lOand it matches with 
desired multimedia informationand records on the storage device 12 of 
the server 10. 

[0033]This pertinent information collection processing (Step 503) In 
addition to desired multimedia informationattribution information 
registration processing (Step 501)When there is at least one or more 
multimedia information which already carried out search key generation 
processing (Step 502) and pertinent information collection processing 



(Step 503) Comparative collation with that which was collected to the 
pertinent information collected to these multimedia information and 
desired multimedia information may be performedand the relevance of the 
pertinent information on the multimedia information of the above- 
mentioned request and these multimedia information may be evaluated. 
When it matches with the multimedia information of the above-mentioned 
request of the pertinent information to which other multimedia 
information relates and records on the storage device 12 of the server 
lOthe identifier of other related multimedia information and its degree 
of association may be doubled and recorded. 

[0034] In the document of the pertinent information which shows a user 
the pertinent information collected in the above-mentioned pertinent 
information collection processingand shows a user desired multimedia 
information or related registration multimedia informationlayout 
arrangement is carried out and the above-mentioned presentation 
processing (Step 504) is shown. 

[0035]When desired multimedia information and related registration 
multimedia information are a taken imagethe example of the screen of the 
presentation processing (Step 504) which layout arrangement is carried 
out and is outputted in the document of the pertinent information shown 
them at the indicator 24 of the client 20 is shown in drawing 6 . In the 
example shown in this drawing 6 the business which displays the right- 
hand side of a screen and the document 61 of pertinent information on 
left-hand side arranges the taken image 60. This layout is not limited 
to this and can be changed variously. 

[0036]Processing of the above-mentioned multimedia information record 
management system may carry out all the processings using CPU11 of the 
client 20and the storage device 12 except for the retrieval processing 
of database [ in pertinent information collection processing ] 30or 
WWW50. 

[0037]Nextan example is given and processing of the multimedia 
information record management system of this embodiment mentioned above 
is explained in detail. Herethe case where the taken image which the 
user photoed as multimedia information in the travel destination is 
recorded is taken and mentioned. 

[0038]Firstin attribution information registration processing (Step 
501) that for which a user is the multimedia information registered into 
the storage device 12 of the server lOand asks is downloaded to the 
client 20and it outputs to the indicator 24. 

[0039] And text information which carried out photograph recording of the 
attribution information over the informationi. e. the informationsuch as 



information on a place and a titleis inputted by the instruction input 
part 23perusing the multimedia information. 

[0040] Drawing 7 and drawing 8 are the figures showing the example of the 
screen displayed on the indicator 24 of a client by attribution 
information registration processing (Step 501) when the multimedia 
information downloaded to the client is a taken image. 
[0041] it is the file name (identifier) in which the photographed image 
data in which "file name" 241 are displayed is stored in this example of 
a screen — the object for user validations — a system — it is 
displayed automatically. A user is this screen and inputs text 
information (both inside at least on the other hand) which photoed the 
picturesuch as information on a placeand a title. 

[0042] Drawing 7 shows the example as which the file name 241 inputted 
only the title 242 and the text information of the comment 243 to the 
taken image which is "photograph 0000. " 

[0043] On the other hand drawing 8 shows the example which inputted only 
the camera station information 244 on a place (latitude longitude) that 
the picture was photoed to the taken image whose file name 241 is 
"photograph ********. " 

[0044] The input of the camera station information 244 stores the 
electronic chart database in the storage device 12 of the server 10 
beforehandThe user enables it to output the map of the point 
circumference with which the picture was photoed to the indicator 24 of 
a client from the databaselt may enable it to input the camera station 
information 244 on the picture concerned by furthermore specifying the 
photography point of the picture on a map by the instruction input parts 
23such as a mouse. Howeverwhen this picture is photoed with the digital 
camera in which GPS connection is possible. The photography latitude 
longitude information automatically given to that picture is indicated 
by default at an input column (at this timeit is desirable to display 
collectively the map which marked that photography latitude longitude 
point) and a user checks this and it may be made to input it. 
[0045]And by pushing the registering button 245 under a screenthe 
information inputted in the pictures is uploaded to the server lOand it 
records on the multimedia information recording file 120 stored in the 
storage device 12 of the server 10. 

[0046] The attribution information of "photograph 0000" and "photograph 
********" which were inputted into drawing 9 by attribution information 
registration processing (Step 501) shows the example of the file 
description recorded on the multimedia information recording file 120. 
[0047]As shown in drawing 9 it is recorded on the multimedia information 



recording file 120 in order of a file namecamera station informationa 
titleand a comment. The record to the multimedia information recording 
file 120 is not limited to this. 

[0048]Nextin search key generation processing (Step 502)CPU11 of the 
server 10 generates the search key for searching database 30 or WWW50 
from the attribution information of the multimedia information recorded 
on the multimedia information recording file 120 mentioned above. 
[0049] A noun (green in Kyoto Old Palace and the Imperial Garden) is 
extracted applying the inputted title 242 and the text information of 
the comment 243 to a morphological analysis to above-mentioned 
"photograph 0000"and this creates a **** key. 

[0050] On the other handto "photograph ********"a search key is created 
with a latitude longitude value (35/00/43.5135/47/07.3). In above- 
mentioned attribution information registration processing (Step 501) when 
the both sides of the camera station information 244 and the text 
information of the title 242 and the comment 243 are inputted as 
attribution informationA search key is created by both of the keyword 
created from the camera station information (latitude longitude value) 
244 and the title 242and the text information inputted into the comment 
243. 

[0051] In pertinent information collection processing (Step 503) the 
search key created by the search key generation processing (Step 502) is 
submitted to the database 30 or the search engine 31 of WWW50 from the 
server 20and the pertinent information over the multimedia information 
is collected. 

[0052]To above-mentioned "photograph 0000" the usual retrieval by keyword 
(OR search) by a keyword (green in Kyoto Old Palace and the Imperial 
Garden) is carried out to database 30 or WWW50. 

[0053]Herethe retrieval by keyword to database 30 and WWW50 is explained. 
Fundamentallysince this retrieval processing is similarly carried out to 
WWW50 also to the database 30it explains only the retrieval by keyword 
for the database 30 here. 

[0054] Retrieval by keyword is realized by list-izing the report file 
name containing the word from the congruous lines with reference to the 
inputted search word and the word in the word index table 322 shown in 
drawing 2 . For exampleif the search word "Kyoto Old Palace" is inputted 
to the word index table 322collation with the line whose word column is 
"Kyoto Old Palace" will be successfuland the report file name list of 
the line "report ****" will be obtained as search results. 
[0055] The degree of association which shows how much each searched 
report suits retrieval required is given to search results. 



Fundamentally this degree of association is defined by the frequency of 
occurrence of the search word in the searched report. AND retrieval is 
defined as the sum [ as opposed to each search word in OR search ] of 
search results as a least common denominator of search results to each 
inputted search word. The degree of association in consideration of the 
frequency of occurrence of each search word is similarly defined to 
these search results. 

[0056] On the other handto above-mentioned "photograph ********"the 
position inclination by a latitude longitude value 
(35/00/43.5135/47/07.3) is searched. 

[0057]Herethe position-oriented search using latitude longitude 
information is explained. Fundamental lysince position inclination search 
is similarly carried out to WWW50 also to the database 30it explains 
only the position inclination search for the database 30 here. 
[0058] In the position-oriented search with a position retrieval 
enginethe latitude longitude of the position information database 33 
first shown in the inputted latitude longitude information and drawing 3 
is comparedand the address containing the latitude longitude is 
determined from the congruous lines. Nextthe town page database 34 shown 
in the acquired address information and drawing 4 is comparedand the 
store name applicable to the address is determined. 

[0059] And search results are obtained by the retrieval by keyword of the 
text information database 32 of the database 30 which uses the acquired 
store name as a search key. For exampleby collation with the position 
information database 33supposing an address is "Sakyo-kuKyoto-shi 
00****l-l-l"the inputted latitude longitude informationCollation with 
this address information and the town page database 34 will show that 
that latitude longitude is in "**** shrine"and retrieval processing of 
the text information database 32 of the database 30 which used "**** 
shrine" as the search key will be carried out. About "photograph 
********"from the latitude longitude value of a search keythe latitude 
longitude is in "Heian Jingu"and search results "report $$$$" will be 
obtained by search of the database 30 by a keyword "Heian Jingu. " 
[0060] When the search keys created by search key generation processing 
are a latitude longitude value and the combination of a keywordthe usual 
search by a keyword is carried out to the search results which carried 
out position inclination search by a latitude longitude valuenext were 
obtained first. 

[0061]Pertinent information collection processing (Step 503) is ended by 
uploading the obtained search results to the server 20 at the endand 
recording the contents on the multimedia information recording file 120. 



[0062] Drawing 10 is a figure showing the search results to "photograph 
0000" and "photograph ********* which are recorded on the multimedia 
information recording file 120. As shown in drawing lOp ertinent 
information is added and recorded on the multimedia information 
recording file 120 by a file namecamera station informationa titleand 
the comment. The record to the multimedia information recording file 120 
is not limited to thisand selection distinction may be carried out and 
it may record a file namecamera station informationa titleand the 
information and pertinent information on a comment. 

[0063] In pertinent information collection processing (Step 503). To the 
search results "report $$$$" of "photograph ********"attribution 
information registration processingComparative collation with the search 
results of other multimedia information which already finished search 
key generation processing and pertinent information collection 
processing is performedlt is desirable to evaluate the relevance of 
these multimedia information over each related article of "photograph 
********" an d it may record the evaluation result on the multimedia 
information recording file 120. 

[0064] If "photograph 0000" which already finished attribution 
information registration processingsearch key generation processingand 
pertinent information collection processing is taken up and explained to 
an exampleSearch results "report $$$$" and the search results "report 
****" of "photograph 0000" are comparedand what is a related article of 
"photograph ********" and has become a related article of "photograph 
0000" simultaneously is selected, for examplethe text information 
database 32 of the database 30 — an entry — "Jidai Festival" and the 
text — "— a procession should leave Kyoto Old Palace and should pass 
the Karasuma log town and Karasuma Mi ike — it goes to Heian Jingu from 
three sections of Higashiyama. Will comesupposing the report (a report 
file name is report &&&&) " is containedsince "report &&&&" contains the 
word "Heian Jingu" in the textit becomes the pertinent information on 
"photograph ********"but. On the other handsince this report contains 
one of the retrieval key words of "photograph 0000" "Kyoto Old Palace" 
in the textit also becomes a related article of "photograph 0000. " 
[0065] In such a casereport &&&&is a related article of "photograph 
********"and will be simultaneously evaluated as a thing relevant to 
"photograph 0000. " At this timereport &&&&is a related article of 
"photograph 0000"and it is also estimated by the object nature of the 
above-mentioned processing that "photograph ********" is related. It is 
desirable to also record these results on the multimedia information 
recording file 120. 



[0066] Drawing 11 is a figure showing the relevance evaluation result to 
"photograph 0000" and "photograph ********* which are recorded on the 
multimedia information recording file 120. As shown in drawing 
llpertinent information is added and recorded on the multimedia 
information recording file 120 by a file namecamera station informationa 
titleand the commentand the relevance of a reportphotograph OOOOor 
"photograph ********" is added to pertinent information at percentage. 
The record to the multimedia information recording file 120 is not 
limited to thisand selection distinction may be carried out and it may 
record a file namecamera station informationa titleand the information 
and pertinent information on a comment. 

[0067]Finallythe contents of the multimedia information recording file 
120 obtained by above-mentioned pertinent information collection 
processing (Step 503) are displayed on the indicator 24 of the client 20 
by presentation processing (Step 504). For exampleas shown in drawing 
12when displaying "report &&&&" on the indicator 24 of a clientlayout 
arrangement is carried out at it and "photograph 0000" and "photograph 
********" are displayed. 

[0068]As mentioned aboveas explainedwhen a user records multimedia 
informationsuch as a picture photoed for the travel etc. and a recorded 
soundaccording to this inventionThe semantic content of the multimedia 
information registered from various knowledge-data sets by carrying out 
automatic collection of the various information relevant to the 
multimedia information is informationally extensible by using text 
informationsuch as those recording position informationa titlea 
commentetc. 

[0069]Thereforeit becomes possible to provide the multimedia information 
recording method and system which collected information related from 
various knowledge-data setsand extended the mutual correlation with 
multimedia information. 

[0070] If contents use WWW by which renewal of an addition is carried out 
every day as a knowledge-data setit will also become possible to provide 
for a user by making a Web page with contents with high freshness into 
pertinent information. By thesethe encounter with the information like a 
find relevant to the registered multimedia informationthe study support 
after a positive traveletc. are attainedfor example. 

[0071] It becomes possible according to this inventionto push two or more 
placeMONOetc. which the user visited for the travel etc. in the 
registered multimedia informationand to associate them variouslyand a 
user can be provided with an opportunity to discover after traveling 
various relevance which a user has not noticed during a travel. 



[0072] It becomes possible to associate variously them which the place 
and MONOthe othersor the other groups on whom the user itself called 
visitedif this invention is applied to group travelssuch as a school 
tripln addition to positive after-travel study support into a 
groupcommunity formation support of information exchange between 
userscommunicationetc. is also attained. 

[0073]The multimedia information recording processing program of this 
invention mentioned above may not only be built into a serverbut a 
general user may be provided with it with storagessuch as a mask ROMa 
floppy (registered trademark) diskCD-ROMand DVD-ROM. In this caseit may 
provide for a user other than these processings further combining other 
programssuch as a GUI program. 

[0074] It may provide for counter value through networkssuch as the 
Internetas a substitute means provided with the storage mentioned above. 
[0075]As mentioned aboveas for this invent ionalthough the invention made 
by this invention person was concretely explained based on said 
embodimentit is needless to say for it to be able to change variously in 
the range which is not limited to said embodiment and does not deviate 
from the gist. 
[0076] 

[Effect of the Invention] It will be as follows if the effect acquired by 
the invention indicated in this application is explained briefly. When 
multimedia informationsuch as a picture which the user photoedand a 
recorded soundis recordedby using text informationsuch as those 
recording position informationa titlea commentetc. Since the semantic 
content of the multimedia information registered from various knowledge- 
data sets by carrying out automatic collection of the various 
information relevant to the multimedia information is informationally 
extensibleThe multimedia information recording method and system which 
extended the mutual correlation with pertinent information and 
multimedia information from various knowledge-data sets are realizable. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is a figure for explaining the composition of the 
multimedia information record management system concerning one 
embodiment of this invention. 

[Drawing 2] It is a figure showing an example of the text information 
database of this embodiment. 



[Drawing 3] It is a figure showing an example of the position information 
database of this embodiment. 

[Drawing 4] It is a figure showing an example of the town page database 
of this embodiment. 

[Drawing 5] It is a process flow figure showing the flow of processing of 
the multimedia information recording program in the multimedia 
information record management system of this embodiment. 
[Drawing 6] It is a figure showing the example of the screen of 
presentation processing of this embodiment. 

[Drawing 7] It is a figure showing the example of the screen displayed on 
the indicator of a client by the attribution information registration 
processing of this embodiment. 

[Drawing 8] It is a figure showing the example of the screen displayed on 
the indicator of a client by the attribution information registration 
processing of this embodiment. 

[Drawing 9] It is a figure showing the example of the file description 
recorded on the multimedia information recording file of this embodiment. 
[Drawing 10] It is a figure showing the example of the file description 
recorded on the multimedia information recording file of this embodiment. 
[Drawing 11] It is a figure showing the example of the file description 
recorded on the multimedia information recording file of this embodiment. 
[Drawing 12] It is a figure showing the example of the screen of 
presentation processing of this embodiment. 
[Description of Notations] 

10 [ — Instruction input part] — A serverll21 — CPU1222 — A storage 
devicel323 1424 [ — Search engine] — An indicator20 — A client30 — A 
database31 32 [ — A network50 / — WWW120 / — A multimedia recording 
filel21 / — Multimedia recording program. ] — A text information 
database33 — A position information database34 — A town page 
database40 



